A contraction method with implementable proximal regularization for linearly constrained convex programming
نویسندگان
چکیده
The proximal point algorithm (PPA) is classical, and the resulting proximal subproblems may be as difficult as the original problem. In this paper, we show that with appropriate choices of proximal parameters, the application of PPA to the linearly constrained convex programming can result in easy proximal subproblems. In particular, under some practical assumptions on the objective function, these proximal subproblems become implementable in the sense that they all have closed-form solutions or can be efficiently solved up to a high precision. We thus present a contraction method with implementable proximal regularization for linearly constrained convex programming, and its global convergence is proved easily under the analytic framework of contraction type methods.
منابع مشابه
An accelerated proximal augmented Lagrangian method and its application in compressive sensing
As a first-order method, the augmented Lagrangian method (ALM) is a benchmark solver for linearly constrained convex programming, and in practice some semi-definite proximal terms are often added to its primal variable's subproblem to make it more implementable. In this paper, we propose an accelerated PALM with indefinite proximal regularization (PALM-IPR) for convex programming with linear co...
متن کاملAlternating directions based contraction method for generally separable linearly constrained convex programming problems
The classical alternating direction method (ADM) has been well studied in the context of linearly constrained convex programming problems and variational inequalities where both the involved operators and constraints are separable into two parts. In particular, recentness has witnessed a number of novel applications arising in diversified areas (e.g. Image Processing and Statistics), for which ...
متن کاملProximal alternating direction-based contraction methods for separable linearly constrained convex optimization
Alternating direction method (ADM) has been well studied in the context of linearly constrained convex programming problems. Recently, because of its significant efficiency and easy implementation in novel applications, ADM is extended to the case where the number of separable parts is a finite number. The algorithmic framework of the extended method consists of two phases. On each iteration it...
متن کاملSymmetric ADMM with Positive-Indefinite Proximal Regularization for Linearly Constrained Convex Optimization
The proximal ADMM which adds proximal regularizations to ADMM’s subproblems is a popular and useful method for linearly constrained separable convex problems, especially its linearized case. A well-known requirement on guaranteeing the convergence of the method in the literature is that the proximal regularization must be positive semidefinite. Recently it was shown by He et al. (Optimization O...
متن کاملLinearized Alternating Direction Method of Multipliers for Constrained Nonconvex Regularized Optimization
In this paper, we consider a wide class of constrained nonconvex regularized minimization problems, where the constraints are linearly constraints. It was reported in the literature that nonconvex regularization usually yields a solution with more desirable sparse structural properties beyond convex ones. However, it is not easy to obtain the proximal mapping associated with nonconvex regulariz...
متن کامل